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Abstract. We provide, under proper assumptions, a description of ad- 
ditive partition entropies. They are real functions I on tlie set of 
finite partitions that are additive on stocliastically independent parti- 
tions in a given probabifity space. 

Second version, 2012-02-22. Tliis version looks closer into the notion 
of continuity. All changes, with the exception of small typografic ones, 
to the previous version are shown in this colour. 



1. Introduction 

The classical discrete theory of entropy concerns itself with real functions 
H defined on the family of sequences (pi,...,pn] such that Pi > and 
^ Pi = 1 . There, the most significant role of all entropies is played by the 
Shannon entropy, given by H(pi,... ,pn) =pi log ^ + . . . + pnlog ^. (In 
here, as throughout the paper, we confine ourselves to base 2 logarithms, 
as dictated by information theory tradition). It is the only symmetric (i.e. 
independent of the order of pi-s) continous function of such sequences that is 
normalised by H(l/2, 1/2) = 1 and satisfies the following grouping axionil] 

H( aipi,...,akPi , bip2,...,bip2 , ••• , Cipn, . . . , C^uPn ) = 

H(pi,P2, ••• ,Pn) 

+ piH(ai,...,ak) +p2H(bi,...,bi) H h pnH(ci , . . . , Ciu). 

Arguably, the grouping axiom can be singled out as the most important 
and almost defining property of Shannon entropy. Even so, a noticeable 
part of Information Theory has been played by either some modifications 
or weakened statements of the grouping axiom. Among them there is the 
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^This result which is a little better than Shannon's own set of axioms (see [2^) is a 
version of Fadeev's axioms of entropy, c.f. [ij • The grouping axiom is often called strong- 
additivity. In terms of conditional entropy of random variables it can be succinctly 
expressed as the so-called chain rule H(X,Y) = H(X) + H(Y|X), (see [ll[. Theorem 2.2.1). 
The shape of the grouping axiom, can lead us to think about the differences of entropies 
between two partitions, one coarser than the other. Indeed, a simple, but a very neat 
reformulation of the grouping axiom in these terms as a certain linearity property can be 
found in 
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important and much weaker property, called additivity, satisfied not just 
by Shannon entropy but also by the earlier concept called Hartley entropy 
(see Example [4l in Section 2, c.f. [iB]) and Renyi entropy (see Example [3] in 
Section 2, c.f. [21[): 

(1) H(p®q) = H(p)+H(q), 

where 

P = (pi,---,Pn),q = (qi,...,qm), 

P q = (piqi, . . . ,piqTu,P2qi, ■ ■ ■ ,P2qm, • • • ,Pnqi, • • • ,Pnqm)- 

Every symmetric H that satisfies this equation is called an additive en- 
tropy. Hartley and Renyi entropies proved themselves useful and appli- 
cable in many fieldsl Additivity can be found in some axiomatisations of 
Shannon entropy, one notable instance that also gives an axiomatisation of 
Hartley entropy is given in [3]. 

There are quite a few other entropies of sequences and their properties. 
For their detailed exposition, see [3]. For a modern survey of characterisa- 



tions of Shannon entropy (among other things), see jl2l |. 

Now, the natural setting in which entropies appear in most applications 
is not on a family of sequences but on a space of events. Indeed, a finite 
partition can be regarded as a representation of the information carried by 
experimentally collected data (see e.g. It seems therefore only fitting 

and indeed often necessary to introduce the concepts of entropy that take 
events into account. This has lead to the development of 'mixed theory of 
information' by Aczel, Daroczy and others. This theory is a research of 
various so-called inset entropies and was introduced in a series of papers, 
beginning with 0]. 

Consider a ring "B of subsets of O. Before, we were considering a family 
of sequences of positive numbers (pi,...,pn) that sum up to 1. Riding 
roughshod over certain detailsjl we now consider a family S of sequences of 
pairs (At, Pi) such that A^-s are elements of 23 which make up a partition, 
and Pi-s, as previously, are positive and add up to 1 . On such a family we 
consider functions I : 9 — ^ IR- 

Various conditions analogous to symmetry, strong-additivity, additivity, 
and so on lead on to different inset entropies I. For instance we can define 
additive inset entropy by demanding a version of symmetry and a version 
of additivity 

At n bA _ ^ MA ^ ^ /Bj 



^ Piqj ) ^ \Vi) ^\qj 



■^Renyi entropy, for instance, is used in random search [2^1 . coding theory cryptog- 
raphy [8[, and differential geometric aspects of statistics [lOj]. 

■^There are actually several different flavours of inset entropy. For instance, it is some- 
times assumed that the ring B is an algebra (contains O) and we consider partitions of 
CI, at other times we consider partitions of all sets in 25. We can consider positive pi-s or 
just nonnegative. The sets can be nonempty or not neccessarily. 
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Inset entropies have recently found application in considerations involving 
utility function in gambling, see 

We propose a related, yet different, approach. We are given a nonatomic 
probability space (O, L, P). Let 21 be the family of all finite subalgebras 
of cr-algebra L, or in other words algebras generated by finite partitions 
O = Ai U • • • U An, Atfl Aj = 0. Consider the following version of additivity 

(2) i(a(yius)) = i(yi) + i(S), 

for any independent finite algebras A and "B. 

It is the aim of the current paper to examine the family of functions 
I: 21 — ) IR satisfying condition ([2]), which we shall call additive partition 
entropies0 It turns out that this research leads to a simple and effective 
description. 

Of course, every additive entropy H can be viewed as an additive partition 
entropy Hp, (Hp)(o-(Ai, . . . , An)) = H(P(Ai), . . . ,P(An)) that depends only 
on probabilities of atoms. 

But there are other additive partition entropies. In fact, given x G O 
consider the function : 21 — > R, 

Lx(.A) = log p(X7' where Ax is the atom of A that contains x 

Naturally, this function satisfies equation ([2]). 

Here is the main result of the paper: "Let I be a continuous additive 
partition entropy. There exist a continuous entropy H, and a countably- 
additive set function m absolutely continuous with respect to probability P 
such that I is a sum of two continous additive partition entropies 

I = Hp + Lx(-)Tn(dx), that is 
Ja 

n 

I(yi) = H(P(Ai ),..., P(An)) + Y_ "^(AO log p(l^ 

i=l 

Moreover we can assume that tn(0) = 0, in this case such a decomposition 
is unique." 

Let us mention that a somewhat related result, however with much stronger 
assumptions, and in the setting of additive inset entropy has already ap- 
peared in [ij], see also [l7| . 

The above result shall be presented as a corollary in Section 5, Theorem[2j 
Sections 2-4 contain a proof of a slightly more general Theorem [TJ namely it 
is natural to replace the probability P with a somewhat more general notion 
of a finitely- additive measure P. A follow up paper (25l | concerns a similar 
result in which there are no continuity assumptions. 

The proof of Theorem 1 is longer than might be expected. The major 
difficulty lies in the construction of component J^Lx(-)n^(dx), i.e. in finding 



*The term 'partition entropy' lias been introduced earlier in the context of partitions 
of a finite set, see e.g. [Ij. Additive entropy of partitions has been considered in 
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the measure m. The construction, is made of two parts — one is probabihstic 
in that it depends heavily on the notion of independence (point I below), the 
other involves algebraic manipulation of measures (points II and III below). 
Theorem 1 is a corollary to the following results: 

I (cf. Propositions m and m Section 3) If I is a continuous (see definition [4] 
below) additive partition entropy then for any events V, W with P(V) = 
P(W) we can define the number A(V, W) in such a way that the following 
conditions are satisfied 

(a) Whenever there is a partition (Ai , . . . , A^) with V C Ai , W C A2, 
P(A2)/P(Ai) = A we have 

A(V,W)logA = I(Ai A (VUW),A2 A (V U W), . . . , An) 

-I(Ai,A2,...,An) 

(b) If P(U) = P(V) = P(W) then 

A(U,W) = A(U,V) +A(V,W). 

(c) For V = Vi U V2, W = Wi U W2, Vi n V2 = 0, Wi n W2 = 0, 
P(V^) = P(Wi), i = 1,2 we have 

A(V,W) =A(Vi,Wi)+A(V2,W2). 

(d) A(-, •) is continuous in metric d(V,W) = P(V A W). 

II (cf. LemmaEl Section 3) If A(V,W) defined for P(V) = P(W] satisfies 
(b)-(d) then there is a unique finitely-additive measure m, absolutely 
continous with respect to P such that m(0) = and 

A(V,W) =m(W) -m(V). 

Ill (cf. proof of Theorem 1, Section 4) Assume that for some continous 
additive partition entropy I, and measure m ^ P we have 

[m(W) -m(V)]logA = I(Ai A (VUW),A2 A (V U W], . . . , An) 

-I(Ai,A2,...,An), 

for P(V) = P(W), and a partition (Ai,...,An) with V C Ai, W C A2, 
P(A2)/P(Ai) = A. It turns out that T(yi) := I(yi)-£TL, m(AO log pj^(yi) 

is a continous additive partition entropy such that 1{A) = I('B) for any A 
and S generated by Ai , . . . , An and Bi , . . . , Bn such that P(Ai) = P(B|), 
1 < i < n. 

All propositions say something about either continuous or general addi- 
tive partition entropies and they all follow easily from either continous-case 
Theorem [1] or an analogical general result in [25|. The lemmas, however, 
are of an 'independent' nature and some of them, especially Lemmas 7-9, 
might find themselves useful somewhere else. 
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2. Basic notions and notation 

We shall denote the characteristic function of a set A by 1^- We shall 
write A = ^ At or A = Ai + • • • + A^ , whenever we have A = |J^ <i<n 
and the sets A^ are pairwise disjoint. 

Fix a space (0, 3", P)with a finitely-additive probability measure P defined 
on some algebra 3" of subsets of O. We shall consider the family 21 = 21(3") 
of all finite subalgebras of the algebra 3~. From now on, we shall hold on to 
the following assumption regarding measure P 

Darboux Property. For any set A G 3" and any < 9 < P(A) there is 
B € 3" such that B C A and P(B) = 9. 

Let us remark that in case (0, 3", P) is a usual probability space, the 
Darboux property is satisfied if and only if the space is nonatomic. 

Now, going back to the finitely-additive case, we have a naturally-defined 
notion of an integral of an ]RU{+oo}-valued simple function. We shall assume 
that • (+oo) = 0. 

For any K G 3" such that P(K) > 0, we shall consider a truncated condi- 
tional probability space (K, 3"|k, P|k)- This means that A € 3^|k is equivalent 
to A E 3" A A C K and that 

P(A) 



P|k(A) 



P(K) 



Undeniably, any such "subspace" satisfies our Darboux Property 

By 21|k we shall understand 21(3"|k), i.e. the family of all finite subalgebras 
of 3"|k. For any A € % hy Ak G 21|k we shall denote {A n K: A € ^1}. For 
every finite family S C 3", by o'(S) G 21 we shall understand the algebra 
generated by S, that is the smallest algebra containing 9- 

In the sequel we shell often refer to algebras generated by partitions. This 
is why the following special notation might prove convenient. We shall write 

A = (Ai , . . . , An), 

if yi = ct({Ai , . . . , An}) and Ai + • • • + An = a, Ai 7^ 0, A^ G 3". 

Clearly, every algebra yi G 21 is of shape (Ai , . . . , An). In fact, we have 

{Ai : 1 < i < n} = mine W 

where miuct^l) denotes the set of minimal elements of ^1 \ {0} partially 
ordered by the relation C (the set of atoms of algebra A). 

Notice that, for A = (Ai) and B = (Bj) we have a(yiU'B) = (Ci , . . . , Cj), 
where {Ci , . . . , Cs} := {Ai n Bj : Ai n Bj / 0, 1 < I < n, 1 < j < m}. 

For any A, 23 G 2t we shall write A -L "B whenever these algebras are 
independent, that is when P(A n B) = P(A)P(B) for all A G ^1, B G S. One 
reason for using this symbol is given by the following observation: "Algebras 
A and S are independent if and only if J f g dP = for any simple functions 
f and g, which are measurable with respect to the corresponding algebras A 
and 23, and which have their expected values equal to 0, J f dP = J g dP = 0" . 
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Under the reprepresentations A = (Ai , . . . , An) and S = (Bi , . . . , Bm), the 
independence A J-'B is equivalent to having P(Ai, n Bj) = P(Ai)P(Bj) for all 
i, j. We shall also write 

e = A-'B, 

if _L S and e = a(AuS). 

This paper is devoted to exploring functions of the following kind: 

Definition 1. The mapping I: 21 — > R is called an additive partition 
entropy if it satisfies 

UA-'B) = l[A) + l['B), 
that is if for any A, S G 21 such that A ± B we get UiyiAWB)) = l(A]+l['B]. 

Let us state several exampes that will play a role in the general de- 
scription of additive partition entropies. Before we do that, however, con- 
sider the following crucial function L : 21 — > R^, which to a given algebra 
A = (Ai , . . . , An) € 2t assigns a simple function 



l<i<n^ ''"^"^ 

Evidently, the operator L solves our equation L(yi • 23) = L[A) + L(S]. This 
leads to the followng 

Example 1. Take an arbitrary finitely- additive measure m: 3" — > R, van- 
ishing on sets of V-measure zero. We obtain an additive partition entropy 

n-A) &m = Y_ n^(Ai) log 



1<i<n 

A special case m = P, gives the Shannon entropy of A 

1 



Lp(yi) = EL(yi) = ^p(AOiog 



l<i<n ^ ^' 

By taking variance instead of expectation, we arrive at 
Example 2. For any algebra ^1 € 21 set 



Y[A] :=D^[L(yi)] 



[L(yi) - EL(yi)]^ dP. 



Since \[A] is the variance of the random variable l-[A) with respect to prob- 
ability P, and since for any independent >l, 23 G 21 the random variable 
\-[A ■ 23) = L(yi) + L(23) is the sum of independent random variables \-[A] 
and L(23), it follows that the mapping V is an additive partition entropy. 

Shannon entropy and Example [2] could be generalised further to any cu- 
mulant. In fact, consider the cumulant generating function (cgf) of L 

t^log(Eexp(tL)) =log(^P(Ai)i-^). 

1<i<n 
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Recall that the cgf of a sum of independent random variables is equal to the 
sum of cgf's of the respective variables. Therefore, any 'linear functional 
on the cgf is an example of an additive partition entropy. This can be the 
cumulants i.e. the coefficients of the power series representation of cgf of L. 
It is also convenient to consider the values of cgf (say at t = 1 — a) , up to a 
constant factor they are the 

Example 3. Renyi entropies of order oi^^ , namely 
Ra(A) := i^log(^P(At)'^). 

l<i<n 

As explained above, or seen directly, these are additive partition entropies. In 
fact, this is the most widely known class of examples of an additive entropy. 
(These entropies were introduced in f2^1. ) 

The role of the leading coefficient 1/(1 — oc) is to ensure that the Renyi 
entropy tend to Shannon entropy as a tends to 1 , (this follows, for instance, 
from a simple use of de I'Hospitals rule, see also [3]). The case a = is 
somewhat special, too. In this case 

Example 4. Rq takes the shape 

A ^ log #{A^ : P(Ai) > 0}, 
and is known as Hartley entropy. (It was defined in fldil.) 

Our final pair of examples have an important use in the research of ex- 
treme cases of complexity theory, (see [261]). 

Example 5. They are the minimum, and the maximum of the simple func- 
tion L(>1); 

I-min((Ai, . . . , An)) := min i<i<n log p7^, 

P(Ai)^0 



c((Ai,...,An)) := maxi<i<n log 



1 



P(Ai) • 
P(Ai)^0 

Definition 2. We say that algebras A and S have the same measures 
of atoms, if we have 

yi = (Ai,...,An), S = (Bi,...,Bn) 

with P[Ai) = P(B|), for 1 < i < n. Also, an additive partition entropy I will 
be said to depend solely on the measures of atoms if I is constant on 
each family of algebras that have the same measures of atoms. 

This is the same as saying that there is a 'classical' additive entropy H, 
such that I = Hp, i.e. UA) = H(P(Ai ),..., P(An)). 

Remark 1. The additive partition entropies of Examples\M^ depend solely 
on the measures of atoms. In cases when m is absolutely continuous with 
respect to P, (see Definition ^ on page 16^ the additive partition entropy 
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from Example [I] depends solely on the measures of atoms exactly when m = 
ccP, for some a € R, i.e. when it is a multiple of Shannon's entropy. 

Indeed, if depends solely on the measures of atoms then there is a 
function f : R — > R such that for any A G 9" we have m(A) = f(P(A)). (In 
fact, if yi = (A,a\A), B = (B,a\B), P(A) = P(B) =: a / 1/2 then we 
put X := m(A), y := m(B) and get 



from which x = y. Ifa = l/2 break A and B into two pieces of equal 
measures.) The function f must be additive and continuous at zero, thus 
linear. 

Incidentally, observe that the mapping m i— > is injective. This follows 
in nearly the same way as equations ([3]) above. 



From now on, when speaking of an algebra or writing A, 23, etc. we shall 
mean an algebra in 21, or in other words an algebra generated by a partition 
of O into a finite number of measurable sets. 

For any algebras A, 23, and % = (Ki, . . . , Kn.) we shall write A J-x 23 if 
for every Ki such that P(Ki) > the algebra ^IIk^ is independent with 23|k|. 

Lemma 1. Let X = (K^ . . . , Kn) C A and P(Ki) > 0, 1 < i < n. Then the 
following conditions are equivalent 

(1) A^'B, 

(2) S _L 3<;,yi _L3c 

If these conditions are satisfied then 

Q = A-'& is equivalent to Ki G S, e^. = A^. ■'B\y^^, 1 < i < n. 

Proof. We leave to the reader the proof that 1 . and 2. are equivalent. 
To show the second equivalence we need the following for % C C 

(4) e = o-(yi U 23) ^ eiK, = ct(A|k, U 25|kJ (1 < 1 < n). 
Since X C S we have 

(5) mine (C) mine (CIkJ. 



(6) minc(cT(yiUS)) =^minc(cT(AUS)|Kj =^minc(cT(yi|K,US|Kj). 



(3) 




3. Some introductory statements 




Similarly from % C (y[A U 23) we obtain 



X 



From ([5]) and ^ we obtain 



□ 
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Lemma 2. For any algebra A and any numbers Ci , . . . , > such that 
^]<cj<_]c Cj = 1 there is an algebra C = (Ci , . . . , Ck) satisfying C _L ^1, P(Ci) = 



Proof. This follows easily from the Darboux property, □ 



Corollary 1. For any algebras A-\,...yAn and any nonnegative numbers 
Ci,...,Ck such that Y.^<]<\^^ — ^ there is an algebra C = (Ci,...,Ck) 
satisfying C _L Ai, 1 < t < n, P(Ci) = Ci. 

Proof. Consider A = g[A-\ , . . . , yin) • □ 

Remark 2. We will often use this Collorary in the following way. For any 
algebras A and 23 having the same measures of atoms there is an algebra C 
with the same measures of atoms such that 

e_Lyi, e_LS. 

Fix any additive partition entropy I. 
Proposition 1. // for some set Z, P(Z) = we have 

■Md\z = 'B|q\z> 

then 

i[A) = im. 

Proof. We can easily find representations A = (Ai , . . . , A^, . . . , Aj) and "B = 
(Bi , . . . , Bn, . . . , Bt) for which the following equalities hold 

P(A^ A BO = (1 < i < n), P(An+k) = 0, P(Bn+i) =0 (k, I > 1 ). 

Observe that any algebra S generated by sets of measure is independent 
with any other algebra from 21. The algebra C := (^[{Ai A B^, An+k, Bn+J) 
is of such a shape and A ■ Q = "B ■ C □ 

Proposition 2. Consider algebras A = {A-\ , . . . , Ai^, Ai^+i , . . . , An) and A' = 
(Ai',...,A(,Ak+i,...,An) with 

P(Ai) = ... = P(Ak) = P(AO = ... = P(A0. 

Then 

l[A) = l[A'). 

Proof. Put K := Ai + • • • + A^. Since the case P(K) = is handled by the 
previous Proposition we assume P(K) > 0. By the same Proposition we 
shall assume K = Q whenever P(K) = 1. Corollary [1] (see Remark [2]) when 
applied to SIIk lets us suppose that ^IIk -L A'\^. 

We shall find S such that A ■ B = A' ■ B. Firstly, define an algebra 

SK = (B^^\...,Bj'')€2l|Kby 



bJ^'^ := ^Ap n A^ (1 < I < k). 



q— p = i (modk) 
l<p,q<k 
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Then yilK • :Bk = ^Hk • ^'k = A\ ■ Sr. 

If K 7^ O then Lemma [2] ahows us to find an algebra 

Bd\k = . . . , G 21|q\k 

that has the same measures of atoms as 23k and satisfies Bq\]< _L ^Io\k- 
Consider 

'^■■= (<'uB;J(,,...,bWub(,^(,)g21. 

By Lemma [1] we obtain the equality A -H = A' -Ti. □ 

Remark 3. As we have seen, all our examples can he made to rely on 
the function L defined just before Example [II This is by no coincidence. 
Propositions^ andl^mean that ifL{A) and L(!B) differ on a set of measure 
then l[A) = 1(23]; in particular every additive partition entropy I factors 
through L, i.e. I = J o L, where 

J(ct) +![))= }(({)) + J(i[)) with 4),i|j € Im(L] and 4), t|j independent. 

Moreover it seems quite plausible that this condition is satisfied for (^,^\),(^ + 
^\) € Lxl(L). In this paper, we don't pursue this approach any further. 

For any disjoint sets V, W E 3" define a nonempty family 5vw of algebras A 
which satisfy V C Ai , W C A2 for some representation (Ai , . . . , A^) of 
algebra A. Also define an operation Tyw^ -Svw dvw by 

Tvw(Ai,...,An) = ((Ai \V)UW,(A2\W)UV,A3,...,An), 

when V C Ai, W C A2. 

Lemma 3. Consider a pair of disjoint sets V, W with P(V) = P(W), and 
algebras yi, 23 € ^vw- Whenever 

we also have 

Tvw2 = Tvvv-^ ■ 'Jvw23. 

Proof. We can set 

yi = (Ai,...,An), B = (Bi,...,B^), e = (Ci,...,Cp), 

with V C Ai n Bi = Ci, W C A2 n B2 = C2. Put A( := At A V A W, 
B( := Bj A V A W and C{. := Ck A V A W for i,j,k = 1,2, and also 
A( = Ai , B-' = Bj, C( = Ck for 3 < i < n, 3 < j < ra, 3 < k < p. 
Then (Aj,...,A^) = 7vw-^, (Bi',...,B^) = Tvw23, (Cp...,Cp) = TywC 
and (q,...,C;) = a(A,',...,A;,B;,...,Bj. 
It suffices to show that 

P(AO = P(AO, P(B()=P(Bj), 

^ ^ P(A(nBj') = P(AinBj). 

When i = j = 1,2 this follows from equalities P(V) = P(W) and inclusions 
V C Ai n Bi , W C A2 n B2. For all remaining pairs i = l,...,n, 
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j = 1 , . . . , m the last of equalities in ([7]) is also clear, and we even have 
A(nB.' = AinBj. □ 

For any A > put 

£(A) := minfl/(l +A),1/(1 + \-^] 



This notation has the following sense — if we divide O into two sets having 
their quotient of measures equal to A then £(A) will be the measure of the 
smaller of them. 

Whenever V n W = and A > write 

5w := {^G2l: ?}5f|=A,Vc Ai,Wc A2 

for some representation A = (Ai , . . . , An) } . 

Lemma 4. For any A > we have what follows: 

A. For any pair of disjoint sets V,W such that P(V),P(W) < £(A) there 
is an algebra A = {A-\ , A2) € dyw 

B. For any algebra A = (Ai,...,An), n > 2 with P(A2)/P(Ai) = A, a 
number k > and sets V C Ai , W C A2 that satisfy 

P(V),P(W) < £(k)£(A)P(Ai +A2) 

there is an algebra S = (81,62) with the property that yi _L 55, 23 G S^vw- 

C. For any disjoint V,W and k > such that P[V),P(W) < £(k)£(A), 
there exist algebras A = (Ai, A2), 23 = (81,82) such that 

^Gi?w> ^g5W> and AL'B. 

D. IfAe 5^)w' andQ=A-'B then 6 G 



Proof. A. If P(V),P(W) < £(A) then by the Darboux property there is a 
partition D = Ai +A2 such that P(Ai) = 1/(1 +A) and P(A2) = 1/(1 +A"^) 
with V C Ai , W C A2. Then P(A2)/P(Ai ) = A. 

B. By the assumptions P|a, (V),P|a2(W) < £(k). According to A. there 

exist sets cf e SIIa^, 1 < i < n, j = 1,2 such that At = cj^' + cf , 
P(cS^Vp(c!^') = K, and V C W C cf. We finish by writing 

8j := cS'' + ... + d'. 

C. follows from A. and B., whereas D. is obvious. □ 
The following lemma is utterly straightforward. 

Lemma 5. Whenever A G 5^^, we have A G S^ViWi' 1 ^ i- ^ o.nd 

/or any V = Vi + • • • + Vn, W = Wi + • • • + Wn. 

Remark 4. It follows from Proposition\^ that if A G 5vw ^^c^ 

l(TvwA) = 1(A). 
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Proposition 3. Consider A > and a pair of disjoint sets V, W with P(V) = 
?[W). 

IfA,'B£dlw then 

I(Tvw^) - I(^) = I(^vwB) - 1(B). 

Proof. Fix algebras A and 23. 

By Proposition [T] we can assume tliat P(V) > 0; then for some k > we 
get a(yiuS) Gj^. 

Suppose for tlie moment tliat we also have 

P(V) = P(W) < e(l/A) • e(K) • P(Ai n B, + A2 n B2), 

where A,,, Bi, are such atoms of algebras A and S that V C Ai n Bi and 
W C A2 n B2. 

With the use of Lemma HJB we find an algebra C = (Ci, C2) G such 
that <y[AU'B) _L S. Then, using LemmaO LemmadP and the Remark above 
we get the equalities I(yi-e) = l[7vwA-7vwQ) and ICB-e) = l(Tvw'B-Tvwe). 
We are done. 

In the general case divide the sets V and W into the same number of 
pieces of equal measure, the measure being bound by 

£(1/A) • £(k) • P(Ai nBi + A2nB2). 

Subsequently apply Lemma [5] for yi, S G dyw ^^'^ ^^-^ U S) G dyw *° 
already derived instance of this Proposition where we have constraints on 
the size of V and W. □ 

Proposition 4. For any sets V, W with P(V) = P(W) and any A > there 
is a unique A(V, W, A) such that the following conditions are satisfied: 

(1) Whenever V n W = and there exists A G we have 
(8) A(V,W,A] = I(Tvw^)-I(yi), 

(2) For any sets U, V and W of the same measure P we have 

A(U,W,A) = A(U,V,A] +A(V,W,A). 

(3) For V = Vi + V2, W = Wi + W2, P(Vi) = P(Wi), I = 1,2 we have 

A(V,W,A) =A(Vi,Wi,A)+A(V2,W2,A). 

(4) For K > we have 

A(V, W, kA) = A(V, W, k) + A(V, W, A). 

Proof. Notice at first that in the case when the family 5vw nonempty, 
Proposition [3] proves that the right hand side of equality ([8]) does not depend 
on the algebra A G 5^^, i.e. that formula dH) defines the quantity A(V, W, A] 
well. Observe also that by Lemma |3]A the family dy/w is nonempty when 
the sets V,W are disjoint and satisfy P(V) = P(W) < £(A). 
The proof is made of three parts. 

I. Assume that dvw ¥^ ^ and define for now A simply by ([8]). In particular 
we assume that V, W are disjoint. Using just defined A's we shall prove 
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property [2] when P(V) = P(W) < (1/2) £(A), property [3] assuming that 
P(V) = P(W) < e(A) and propertyHif P(V) = P[W] < £(K)e(A). 

Indeed, under these assumptions we shall show property [2] by choosing an 
algebra A in such a way that U € Ai , V U W G A2, where A2 is the atom of 
A with A times bigger P-measure than Ai , and noting that 

Then 

A(U,W,A) = I(Tuw^) 

= I[(Tvw o 7uv)A) - l[7uvA) + I(Tuv^) - l[A) 
= A(V,W,A) +A(U,V,A). 

In order to show property [3] we select A G 5vw ^^'^ obtain 
A(V, W, A] = I(Tv,w2 o 7v,wA) " 

= A(V2,W2,A) + A(Vi,Wi,A). 

It remains to prove property [H Observe that by Lemma HP there exist 
e 5^W' S S'vw such that yi ± S. What is more, by Lemma [3P we have 
A ■ 'B ^ T?vw' using Lemma [3] we get 

A(V, W,Ak) = l[7vwiA ■ 'B)) - l[A ■ B) 

= I(Tvw^) - l[A] + I(Tvw^) - 1(3) 
= A(V,W,A) +A(V,W,k). 

Notice also that if P(V) < e(A) then 

A(V,W,A) =-A(W,V,A), 

which we shall use in the next step of the proof. 

II. We drop now the assumption that the sets V and W be disjoint, that 
is we consider the case when 5^v\ww\v 7^ ^ (^'S- when P(V) = P(W) < £(A)), 
and define A by 

A(V, W, A) := A(V \ W, W \ V, A) 

By supposing, if neccessary, that we have P(V) < 1/4 in addition to 
the assumptions of part I, we shall show the required properties [2] and [3] 
(property m is obvious), without assuming that V and W are disjoint. 

In order to to show these properties we note at first that for any U, V 
and W having the required properties and for any X such that P(X) = P(V) 
and X n (U U V U W) = we have 

A(V, W, A) = A(V, X, A) + A(X, W, A) 

Indeed set V' := V\ W, W := W\ V, A = Vn W then divide the set X into 
two parts — X' of measure P(X') = P(V') and B of measure P(B) = P(A). 
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Using step I., we obtain: 

A(V,W,A) = A(V',W',A) 

= A(V',X',A) + A(X',W',A) 

= A(V',X',A) + A(A,B,A) + A(X',W',A) + A(B,A,A) 

= A(V,X,A) +A(X,W,A). 

From the obtained equaUty we arrive at property [2) 

A(U, W, A) = A(U, X, A) + A(X, W, A) 

= A(U, X, A) + A(X, V, A) + A(V, X, A) + A(X, W, A) 

= A(U,V,A)+A(V,W,A), 

and also, by a division of the set X into the parts Xi , X2, with their measures 
equal to P(Vi) and P(V2), respectively we arrive at property O 

A(V, W, A) = A(V, X, A) + A(X, W, A) 

= A(Vi , Xi , A) + A(V2, X2, A) + A(Xi , Wi , A) + A(X2, W2, A) 

= A(Vi,Wi,A) + A(V2,W2,A). 

III. In the general case (P(V) = P(W), A > 0) the number A(V,W,A) 
can be uniquely defined by 

A(V,W,A) :=^A(V,,W,,A), 

l<i<k 

where V = Vi + • • • + Vk, W = Wi + • • • + W^, P(Vi) = P(WO < £(A); and 
where A(Vt,,W|,A) is defined as in part II. 

We shall show now that the number A(V, W, A) is well-defined in this 
way . For any partitions V = Vi + • • • + Vk, W = Wi + • • • + and 

V = V/ + • • • + V/, W = W| H + W/ satisfying respectively P(Vi) = 

P{Wi) < £(A), 1 < I < k and P(V.') = P(W.') < £(A), 1 < j < I, we choose 

another pair of partitions V = V," H h V,;^, W = W|' H h in 

such a way that P(V/') = P(W/') < £(A), and (V|',...,V^) is independent 
with (Vi,...,Vk) and (V|,...,V/) in the space (V, 3"|v, P|v), and also that 
(W;', . . . , W^) is independent with (W, , . . . , W^) and (Wj, . . . , W() in the 
space (W, Jlw, P|w) • Then 

p(V^ n V/') = P(Wi n w/') 
p(\A'n V/') = P(w/n Wj"). 

Hence 

Y_ A(Vt, Wt, A) = ^ A(Vi n V/', Wi n W/', A) = A(V/', W/', A). 

l<i<k l<i<k l<j<m 

l<j<m 

In the same way 

^ A(V/, W/, A) = ^ A(V/', W/', A) . 

l<i<l l<j<Ta 
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It is easy to see that Properties [SHU are satisfied in all their generality. □ 

Remark 5. It is worthy to note that Properties andl^ entail formulas 

A(V,W,A) =-A(W,V,A), 
A(V, W, A) = A(V \ W, W \ V, A); 

moreover, according to PropositionUl i/P(V A V) = P(W A W) = 0, then 

A(V,W,A) = A(V',W',A). 

4. The main result 

In this section we provide a description of continous additive partition 
entropies. However, no notion of continuity has been developed as yet. We 
would like our notion to be as weak as possible, with many continous par- 
tition entropies. Yet, at the same time we want partition entropies Hp to 
be continuous exactly when the corresponding classical enropies H are con- 
tinuous. Here, a subtle distinction should be made. There are two natural 
definitions of continuity for a classical entropy, depending on whether we 
consider nonnegative or just positive probabilities. The same phenomenon 
arises in the context of partition entropies. 

We shall consider a pseudometric dy in algebra 3" defined by 

dj(A,B) = P(A A B). 

By analogy with the classical case we want to consider two topologies in the 
family 21 both introduced as the richest topology so that, in the first case, 
the mappings "similar to the following ones" 

{A G J: < P(A) < 1} 9 A I — >(A,0\A) € 2t 

and, in the second case, the following ones 

{A e 3": < P(A) < 1} 9 A I — >(A,0\A) e 21 

are continuous. To do so we define the closed-domain topology in 2t by the 
following pseudometric: 

d(yi,S) := inf{P(Z): yi|a\z = ^Iq\z}, 

and the stronger open-domain topology by the following one 

D(yi,S) := inf{P(Z): yi|Q\z = S|a\z} + |N (^1) - N(S)|, 

where N(yi) denotes the number of atoms of algebra A with nonvanishing 
measure. 

Definition 3. A function I : 21 — > R is said to be closed- domain con- 
tinuous if it is continuous in metric d and open- domain continuous or 
simply continuous if it is continuous in metric D . 
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We consider closed-domain continuity to be too restrictive, with many 
entropies, like some and Hartley entropy not being closed-domain con- 
tinuous. Open-domain continuity on the other hand, plays nicely with our 
examples and our theory. To see that let us first make precise the following 

Definition 4. A finitely- additive set function m: 9" — > IR, is said to he ab- 
solutely continuous with respect to measure P (m ^ P) if it is continuous 
in pseudometric dj, or equivalently if for any £ > there is a b > such 
that if we have P(A) < 6 then we also have m(A) < e. 

Recall that in case of finitely-additive measures the vanishing of m on sets 
of P-measure does not imply the absolute continuity of m. Now we have 

Remark 6. Additive partition entropy L^, from Example[J\is open-domain 
continuous, when m is absolutely continuous with respect to P. (As it will 
follow from Theorem[J\ and Remark[J\ there are no other continuous additive 
partition entropies of this shape.) 

We shall show the continuity of in case when m ^ P. Fix algebra 
yi = (Ai , . . . , An) and < £ < 1 . There is a < 5 < 1 such that if 

P(Ai A B) < 5, 1 < t < n, 

then 

|logP(AO -logP(B)| < £ and |m(Ai) - m(B)| < £. 

If now d[A,'B] < 6 < 1 then the algebras A and "B have the same number 
of atoms of nonzero measure. We can assume that !B = (Bi,...,Bn) and 
P(Ai),P(Bi) > 0, and also that P(Ai A Bi) < 5. Then 

\^m[A) - = 1^ m(AO log - ^ m(Bi) log p^i^] 

<^\m[A,] (logp^-logp(l^)| + 

^|(m(Ai)-m(BO)logp(^| 

< ^\m[Ai]\t+'^elog-p^ 

< £ ^ |m( AO I + £ (£ + log p(^) 

< £ • const (yi). 

Remark 7. Given a 'classical' additive entropy H, the correspondig par- 
tition entropy Hp is continuous if and only if H is continous on the open 
domain, that is if each function 

H|{(p,,...,p^):p^>o,;^Pt=i} 

is continuous. Hp is closed-domain continuous iff H is continuous every- 
where. It follows that, entropies of Examples o-re continuous^ 



^Please note that Hartley entropy, and Lmin are not closed-domain continuous. 
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It turns out that in the derivation of our main theorem (Theorem [T]) we 
can do with weaker concepts than that of open-domain continuity. In fact, 
we do not need the continuity on the full family 2t. It will be sufficient to 
assume that I is continuous on the family of algebras with 2 atoms. Let for 
that matter 2I2 denote the family 

2t2:={(A,B):0<P(A)<1}. 



Definition 5. We say that I is continuous on %2 if the restriction I212 of 
I to 2I2 is continuous, that is if for any sequence of sets A, Ai,A2,... G 3" 
with < P(A) < 1 such that P(A A An) — > we have 

i((An,a\An)) ^i((A,a\A)). 

Proposition 5. If the additive partition entropy 1 is continuous on 2I2 then 
for any sets V, W such that P(V) = P(W) there is a A(V, W) satisfying 

A(V,W,A) = A(V,W) -logA (A>0). 

What is more A has the following properties: 

(1) For any sets U, V and W of the same measure 

A(U, W) = A(U, V) + A(V, W). 

(2) For V = Vi + V2, W = Wi + W2, P(Vi) = P(Wi), i = 1 , 2 we have 

A(V,W) = A(Vi,Wi)+A(V2,W2). 

(3) A(-,-) is uniformly continuous (in the topology induced from the one 
in 7.) 

Proof. By A(V, W, A) = A(V \ W, W \ V, A) and property [3] of Proposition H 
in order to prove the first part of Proposition, we can assume that the sets 
V and W are disjoint and that their measures are smaller than 1 /2. 

At first, we shall show that the mapping A 1—) A(V, W, A) is continuous at 
A = 1 . Indeed, consider the following open neighbourhood of the point 1 € 
R: G := {A : P(V) < e(A)}. Consider also any sequence (Ai)i>i such that 
Ai^ G G and A,^ — ) 1 . By the Darboux property] (see also Lemma dJ^) we 



shall find algebras Ai = {A\ , A2) G Syw ^'^^ ~ ('^1 > ^ ^vw such that 
y[A] A Ai ) — > when i — > 00. Then, from the continuity of I we get 

and consequently A(V, W, AO — } A(V, W, 1). 

Next by property [4] of Proposition |4] and the fact that A(V, W, •) is con- 
tinuous at A = 1 we see that there is a constant a G with 

A(V,W,A) = a logA (A > 0]. 

Put A(V,W) := a. 
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Property [1] and property [2] follow from the corresponding properties in 
Proposition [H 

As it follows from property El to get uniform continuity we only need to 
show that A is continuous at V = W = 0; i.e. it suffices to show that for any 
£ > we can find 6 > such that if P(V) = P(W) < 5 then |A(V, W]| < e. 

Fix £ > 0. Using the continuity of the function I at the point (Ki , K2), for 
any fixed partition P(Ki) = 1/3, P(K2) = 2/3 of the space D. we shall find 
5 > such that for any algebras (Li,L2) which satisfy P(Ki A Li) < 48 (and 
P(Li) = 1/3) we have |I((Ki , K2)) - I((Li , L2))| < e/2. 

Now, let the sets V,W satisfy P(V) = P(W) < 5. Put V = V \ W, 
W = W \ V. We can assume that 8 < 1/6; then we can find sets V" and 
W" such that V',W',V",W" are disjoint and which satisfy the following 
equalities 

p(v' n Ki ) = P[V" n K2), P(v' n K2) = p(V" n Ki ), 
P(w' n Ki ) = ?{w" n K2), P(w' n K2) = p(w" n Ki ). 

Set 

Li := (Ki U V U V") \ (W U W"), L2 := a \ Li , 
L;:=LiAV'aW', L2:=a\Lj. 

Then 

7v'W' (Li,L2) = (L;,L^), P(Li) = pan = 1/3, 
P(Ki A Li) =2P(V') <26, P(Ki A L;) < 4P(V') < 46. 
From this we get 

|A(V,W)| = |A(V', W',2)| = |I((M,L^)) - I((Li,L2))| < £. 

□ 

Recall that P is defined on the a-algebra 3". Let "Jl be the family of all 
sets in 3" whose measure is rational. 

Lemma 6. Let A(V, W) G IR 6e defined for any pair of sets V, W € 3? of the 

same measure P and let it satisfy the following conditions 

(1) For any sets U, V and W of the same measure 

A(U,W) = A(U,V) +A(V,W). 

(2) For V = Vi + V2, W = Wi + Wi, P(Vi) = P(Wi), i = 1 , 2 we have 

A(V,W) =A(Vi,Wi)+A(V2,W2). 

There is a unique finitely- additive set function m: 3? — > IR with m(0) = 
such that for any sets V and W with Vn W € 3i (^i.e. belonging to the same 
algebra S C and satisfying P(V) = P(W) we have 

(9) A(V,W) =m(W) -m(V). 
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What is more, for any A G 3? we have 

(10) |m(A)| < sup|A(-,A)|. 
Proof. Let Ai H h An = O with P(Ai) = 1 /n. Write 

(11) m(Ai + • • • + Ak) := -1- ^ A(At, + • • • + A^^, A, + • • • + A^), 

C{l,...,n} 

(where by writing {ti , . . . , we assume that these numbers are all distinct). 
Using property E] of Proposition [5] we obtain 

(12) m(Ai+--- + Ak) = -^ ^ A(Ai.,Aj) = i ^A(At,Aj). 

{i,,...,ik}C{l,...,n} l<j<lc 
l<j<k 

We show first that m is well defined. Indeed, if D = (Di , . . . , Dns), 
P(Dp) = l/(ns) and yi = (Ai, . . . , An) C D say A^ = D(i_i)3+i + • • • + D^s, 
1 < i < n then 

}^A(Dp,Dq) = sA(At,A3). 

(i-l)s+l<p<ls 
(j-l)s+l<q<js 

Hence 

(13) i XA(At,Aj) = ^ ^A(Dp,Dq). 

1 <i<n l<P<Ti^s 
l<j<k l<q<ks 

If we have now any other partition Bi + • • • + Bm. = O, P(Bj) = 1/m such 
that Ai + • • • + Ai^ = Bi + • • • + Bi then there is a partition Ci + ■ ■ ■ + Cj, 
P(Cv) = 1/s such that Ci H h Cr = Ai H h A^ and 

(Ci , . . . , Cr) -LA,+---+Ak (Ai , . . . , Ai^), (Bi , . . . , Bi) 

(Cr+l , . . . , Cs) -LAk+,+---+An (Ak+1 5 • • • ) An), (B^+i , . . . , Bm). 

(Naturally, the symbol _Lk denotes the conditional independence of algebras 
in 21|k, with respect to the truncated conditional measure P|k = P(0/P(K).) 
By the rationality of measure P(D), where D is any atom of the algebra 
yi • C, we can find an algebra T) D A,Q, all atoms of which Di , . . . , D.^ are of 
the same measure. In particular, d is a multiple of both n and s; moreover 
we can assume that for some e we have Di + • • • + Dg = Ai + • • • + A^. 
Observe now that formula (I13p gives 

l^A(Ar,Aj) = l^A(Dv,D^) = l^A(CH,Ck). 

l<i<n 1<v<d l<h<s 

1<j<k l<w<e l<k<r 

Similarly 

^^A(B,,B^) = l^A(CH,Ck). 

l<v<Ta l<h<s 
l<w<l l<k<r 
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This proves that m is well defined. 

The additivity of the mapping m follows from equality (jl2p . What is more 
we have A(V, W) = m(W)-m(V) for VnW G X Indeed, if V = Ai + • • •+Ak 

and W = A(^(i ) H h A(j(i^) where P(Ai ) = . . . = P(An) and o-(i) G {1 , . . . , n} 

then 

^(V,W) = -1- }^ A(Ai +--- + Afc,A<,(i) + --- + A<,(fc)) 

^1^^ {ii,-,ik} 
C{^,...,n} 

= "pr H A(Ai, +••• + Ai^,A<,(i ) + •••+ A<,(k)) - 

^"^^ {il,-,ik} 
C{l,...,n} 

A(Ai^ + ---+Ai^,Ai +---+Ak) 

= m(W) -m(V). 

Definition pT]) now gives m(n) = 0. Conversely, if m satisfies m(0) = 
and Q it must satisfy (jlip and so m is unique. Inequality (jlOp follows from 
definition ([HD. □ 



Lemma 7. Lei A(V, W] G K, &e defined for any pair of sets V, W G 3" o/ the 
same measure P and let it satisfy conditions [7H2I of Proposition O There is 
a unique finitely- additive set function m: 9" — > R, absolutely continuous with 
respect to measure P such that m(0) = and such that for any sets V and 
W of the same measure P we have an equality 

A(V,W) =m(W) -m(V). 

What is more, for any A G 3" we have |ra(A]| < supjA(-, A)|. 

Proof. We will extend m from Lemma [6] onto the whole algebra 3". 

With the help of uniform continuity of A it is easy to show that for any 
measurable set A the supremum of |A(-, A)| is finite and that the mapping 
A I—) sup|A(-, A]| is continuous. 

Let now 3? 9 A^ — ) A G J, i.e. P(A A A^) — ) 0. Then we have 
limi,j_^+oo P(Ai \ Aj) = 0, and then by ^ limi,j__^+oo m(Ai \ Aj) = 0. 

Hence limtj >+oo|ni(Ai,]— m(Aj)| = 0, which means that the sequence ra(Ai) 

converges. Put m(A) := limm(AO. Clearly m(A] is well defined; (indeed, 
by taking any other sequence — > A, it suffices to consider the com- 
bined sequence Ai , Bi , A2, B2, . . . — > A thereby getting the convergence of 
m(Ai],m(Bi ),m(A2), . . . ). We now get inequality (fTO]) for any A G 3"; in 
particular it signifies the absolute continuity of m with respect to P. The 
additivity of m, the equality A(V, W) = m(W) — m(V) and the uniqueness of 
m follow from analogical properties obtained previously for rational values 
of P. □ 

Notice that the converse of the above lemma is trivially valid — having m 
as in the thesis of Lemma, A satisfies conditions [THS] of Proposition O 
We shall go over now to the crucial theorem of this paper. 
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Theorem 1. Every additive partition entropy I, continuous on Sta has a 
unique decomposition into additive partition entropies: 

I=I+U, 

where I is an additive partition entropy depending solely on the measures of 
atoms, whereas Lm is a continuous additive partition entropy from Example{^ 
for some finitely- additive set function m absolutely continuous with respect 
to P such that m(0) =0. If I is continuous, then so is I. 

Proof. Let m will be as in Lemma [7] for A of Proposition [5j Observe at first 
that the additive partition entropy I defined by 



l[A) ■.= l[A)-Lm[A) = l[A) 



m(Ai)log 



P(A, 



+ 



+ m(An] log 



P(An) 



where A = (Ai , . . . , An), is invariant in the following sense 

l[7vwA] = U-A] for V, W such that A G dvw, P(V) = P(W). 
Indeed, after assuming that V C Aj, W C A2, setting 

Bi := Ai A V A W G 7vwA, i = 1 , 2 
and using the equalities 

A(V,W) =m(W)-m(V) =m(Bi)-m(Ai) =m(A2)-m(B2) 
we obtain 
I(Tvw^) - 1{A) = A(V, W) • log ™ 
= (m(Bi 



P(Ai) 

m(Ai))log 
m(Bi)log 1 



P(Ai 



P(B,) 
1 



+ m(B2]log p(g^, 

LmCJ'vW'^) — Lni(^)- 



-(m(A2)-m(B2))logp^ 

m(Ai)logp(l^ 
+ m(A2) log 



It remains to show that by a sequence of operations of shape Ivwi like 
above, we can go from any algebra A to any other algebra S, with the 
same measures of atoms as A. Let A = {A-\ , . . . , An.) and 23 = (Bi , . . . , Bn), 
P(Ai^) = P(Bi). According to Corollary [1] (see Remark [2]) we may assume 
that A ±'B. Then the sets Kg := A^ n Bj are disjoint and P(Kij) = P(Kj^i); 
moreover for i 7^ j the sets Ki^j and Kj^,^ are contained in distinct atoms A,^, 
Aj of the partition {Ai , . . . , An}. It is easy to see that we have the following 
equality: 

^ = '^Kn_, ,nKn,n-1 ' ' ' ^K, 3K3,, 'J'Ki ,2X2,1 

The uniqueness of the decomposition follows from Remark |1 on page 7[ 
The continuity of the additive partition entropy L^ is described in Remark[6l 

□ 
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5. Final remarks 

At first, let us mention some other possible approaches one might take to 
derive our results. The first prototype of the proof of Lemma [7] was based 
around defining m(1v — Iw) := A(V, W), extending in to the linear space 
generated by functions of shape ly, observing that tn is a continous linear 
mapping, and then extending fn to the space of all continuous functions and 
finally defining m(V) := tn(lv)- 

One could try to prove Theorems [T] by elaborating on Remark [3] and 
a version of Proposition [3l Although unexplored, it seems that such an 
approach would suffer from some problems of its own. 

We would like now to convert our theorem to the typical case of a countably- 
additive probability. To do so, we need the following simple and known 
properties of measure. The proofs are omitted. 

Remark 8. IfP is a countahly- additive measure on o-algebra 3" then every 
finitely -additive set function m absolutely continuous with respect to P is 
countahly- additive. 

Remark 9. Every nonatomic probabilty space satisfies the \Darboux conditioni 

In view of these remarks, we can recast Theorem [1] in the setting of a 
nonatomic probability space (O, Z, P). 

Theorem 2. Let I be a additive partition entropy, continuous on 2I2 (c.f. 
Definition [21 and Definition [^. There exists an additive entropy, and a 
countably- additive set funcion m absolutely continuous with respect to prob- 
ability P such that 

I = Hp + Lm, 

There is only one such pair with m(0) = 0. Ln, is continuous. If I is 
continuous then also Hp is continuous, i.e. H is continuous in the open 
domain, (c.f. Remark^ 

We would like to mention that this result will be transferred to a quantum 



context in a follow-up paper, [20|]. 
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